Entropy Density and Mismatch in High-Rate Scalar Quantization With Rényi Entropy Constraint
نویسندگان
چکیده
منابع مشابه
Entropy Density and Mismatch in High-Rate Scalar Quantization with Renyi Entropy Constraint
Properties of scalar quantization with rth power distortion and constrained Rényi entropy of order α ∈ (0, 1) are investigated. For an asymptotically (high-rate) optimal sequence of quantizers, the contribution to the Rényi entropy due to source values in a fixed interval is identified in terms of the “entropy density” of the quantizer sequence. This extends results related to the well-known po...
متن کاملHigh-resolution scalar quantization with Rényi entropy constraint
We consider optimal scalar quantization with rth power distortion and constrained Rényi entropy of order α. For sources with absolutely continuous distributions the high rate asymptotics of the quantizer distortion has long been known for α = 0 (fixed-rate quantization) and α = 1 (entropyconstrained quantization). These results have recently been extended to quantization with Rényi entropy cons...
متن کاملMismatch in high-rate entropy-constrained vector quantization
Bucklew’s high-rate vector quantizer mismatch result is extended from fixed-rate coding to variable-rate coding using a Lagrangian formulation. It is shown that if an asymptotically (high-rate) optimal sequence of variable rate codes is designed for a -dimensional probability density function (pdf) and then applied to another pdf for which is bounded, then the resulting mismatch or loss of perf...
متن کاملMaximum Rényi Entropy Rate
Two maximization problems of Rényi entropy rate are investigated: the maximization over all stochastic processes whose marginals satisfy a linear constraint, and the Burg-like maximization over all stochastic processes whose autocovariance function begins with some given values. The solutions are related to the solutions to the analogous maximization problems of Shannon entropy rate.
متن کاملRényi entropy and quantization for densities
Abstract—A random variable Z taking value in a finite, nonatomic measure space (X,M, μ) and whose distribution is absolutely continuous with respect to μ is to be described using N labels. We seek the labeling that minimizes the ρ-th moment of the μ-volume of the set of points in X that have the same label as Z. The large-N asymptotics of this minimum are expressed in terms of the Rényi entropy...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Information Theory
سال: 2012
ISSN: 0018-9448,1557-9654
DOI: 10.1109/tit.2012.2192415